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(57)Abstract: 

PROBLEM TO BE SOLVED: To impart degree of 
freedom to an analyzed result, and to process a variable 
length of sequence as the same class, by re-estimating 
frequency probability of a bigram between sequences 
based on front likelihood, frequency probability, and rear 
likelihood. 

SOLUTION: Re-estimation is conducted in a statistical 
language model generating part 20 to provide the 
maximum likelihood estimate using EM algorithm based 
on frequency probability for character lines included in 
sorted classes and conditional character lines and 
frequency probability for a bigram between the classes. 
Frequency probability of a bigram between sequences is 
re-estimated using an expression for expressing the 
frequency probability of the bigram between the 
sequences based on front likelihood for the character 
lines of processing objects put in a front side of a time 
series, frequency probability of the character lines when 
the character line just before the character lines is 
conditioned, and rear likelihood corresponding to the character lines put in a rear side of the 
time series, relating to the respective character lines of the processing objects. Bhmultigram 
statistical sequence models are generated to be output. 
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(54) Hngogj*] *nff»5/-*>a^jwyjaw, *«tt«we^4^giiRt^^^ss 



(57) i#wa*©«H] 

±EA*f*-^t*<5V^T» ^ftSfcfcfeftfcN,, N 2 © 



* t . #n £ htc ? ? * m w fyi* <omsam m 
nmmm #g $ ti-t ? 7 * w ©^v ^ 7 a 

10 £fi£*§5.fc5fc:ff«i£U 7*7- K- ^7 

t <o mzmmmmtz>m±£tizm^x 



(2) 

3 

jmm±ttxm d s unfrt a <£ 5 i^j®-r 5fw 

7^4j&SS= 

fc/^f 5 *>, pJrfe<DMmm&T<D 

to 

[ft*93] ±E^S#Sii, ±MSftMiJ;o 
TfHR3ftfc±!E^>r ^7 ^©iigit^^VT, 7* 
7^7;wy XAtfflv^, ±B«fco^ 9* WMB 

1 5 r t mmt 1 5f* i xn 2ia«<z)SH-^->- 
iwitwi 2 omtiwm i ©wjni< t § 

i 3 © 5 h<D 1 o(cES»^f+W->-^^^ 
tf/^ISt. 30 
[!t#S5] ±EStt, ±feAz7r-^£V>T&* 

lufcv^Sg 2 ©tWJ^H i ©W5»fK t # 

s i , mmmomM<D'mmz&ft thtztz ©t 
-<T©w^j©«s»i, -ttm%±&<nmmux°h 40 

tz^m^mLtzt%xh^^t^<mttm^iJb 

5 5 © 5 *>© 1 o(;iK«©$EtfWv'-7^*^7Vi'4E!c 

7 ] if *ii 1 ibm 6 © 5 *>© 1 oicfe*©^ 

»>-7- > ^X>£j5jogfit*3l 
±fE*{i(±gSwig©^-t'fe9, l!£v-^>^l» 50 



ij#fF 3004254 

4 

STfcO, ±E#g#SB\ :WJ£«$c©itM§©?iJ(£ 

So 

[ft*l8] if*5 l75S6©5^©io{cE(fe©g£ 
[ft#89] A*£ft5&;*fFJ*:Jt©^ra#K:£<5 

v^t, mfeommmm^TAzm^x^prnwiirz^ 
mm?. x^x^i&zhtzmmwm^T'^mm lx% 
[0001] 

&tf±M+ft-ff^r>£fflV>-C, A^J 

SicMi-5o 
[0002] 

[«<z>R#t] Jfi¥, *»»«waWfci3V^-c, *© 
ttlE Sr ft ft 5 fc & l^fi^T/^fflV * 5 3? ft 

<9 % Eii*©^±^u ; f+^B#ra©ffl«©?M*mofc t 

© 5/ - y x X ItW-mX h X) , ^M© v—7" V ^ tt 7 
Stf/ViLTN-gram (N-^A;^:^ N 

»2«±©ej(!«-e*)5. ) mtt, ^B«4 

<Dmm^m&mmmmK$z-%h(Dxh6 0 mm 

Lffl©*IS?!lw. L =wi, w 2 , -, WL©4fig?t*P 

(w, L ) i±^t-e«**i5. 

[0 0 0 3] 

mi] 

L 

p (wi l ) = n p (w, I wtu-j 1 " 1 ) 
t = i 

[0004] w,ii^B^!iw. L o5*>t#B© 
io©^fS^«L, Wi'fiiSB^f) jS@©*|g?iJ?r 
abto ±Eici(^v^-C, «*P (w, | 



5 

rmm\c y mm? (a i b) 

Scifcfcfra rnj iit = ii»t>L*-c©5t*p (w, 

[ 0 0 0 5 ] t C 3T\ ifi^, ±fB££ff^Smx>© 
N-g r amSrfflV^ii^^liOtttg^[6]±$-fr5 

£&IH^-0^ 0 Zthh<D^fMi, *ilLT«©N 
-g r am*x/W^&ft5@jfeg<Z>##tt<BjKj££ft 
?Pt-5fcfcW|V^tlT:fci9, «*©J;^;[£V«£# 

[0006] 7 u-xmmmmm 

i^f+WltJlSftlStft (Stochastic Context Free Gramma 

rs) \chz£?ftxmm\zm^m) xm<tz 
max m*<Dmm*mir5mtfh*) , # 

T©S?#»?g£ftT#;/h 0 

(a) ^S&fi^ftl TK. Ries et al. , " Class phra 
se models for languagemodeling" , Proceedings of I 
CSLP 96, 1996J IZtS^XM^Zhti: V -7* -VV-7 
7 h (leave-one-out) 

( b ) %M&WX%k 2 TH. Masataki et al. , Variable 
-order n-gram generation by word-class splitting a 
nd consecutive word grouping. Proceedings oflCASSP 

96,1996] \Cl$^X?M*£htcx.yhvi¥- 0 
[0 0 0 7] 

-c\ ±M<Dmmmmwmfr<D*xm^ztx\ e 

M (Expectation Maximum!"^ frib, MftiU<DM±ib) 

V^Ttt, F^tf, 3 TS. Matsunaga et a 

L," Variable-length language modeling integrating 
global constraints" .Proceedings of EUROSPEECH 9 

7,i997j \c&\^T%m^'&*m^bhx\^t>\ %m 

v\ 

[0 0 0 8] r-T5\ £f>£, 0Ux.«. 

=t}) XA(greedy algorithm)^ ioT#fetL5fcftl^ 

< ftg£ 2 > r ©*£l«£i$ft t o-efe So 9 % 
{Si'^-T^X [bed] (invent 
ory)££*U2\ AtiX^mz" b c d" m±LXh, 
riliS [b c] + [d] , [b] + [c d] , [b] + 

(c) + [d] Wmi-7°'/-sryx\zftm£nZ)Zbli 



(3) ^IT3 0 0 4 2 5 4 

6 

< rm£ 3 > is->r y * © ? y * o^gas frnt z> ¥f& 

Z>o lot, IW|-^7^{-ft$0»5>'-7-i/^SrAti 
&ZtttT*%t£\\ MZ-l$s " thank you for" t" tha 
nk you very much for" HWIZ? 7 7.tAt>&V\ 

[0009] rtiMfel-Sfcfti;:, 

10 SffifiU TS. Deligne et al.," Introducing statis 
tical dependencies and structural constraints in v 
ariable-length sequence models" , In Grammatical In 
ference: Learning Syntaxfrom Sentences, Lecture No 
tes in Artificial Intelligence 1147, pp. 156-167, Sp 
ringer, 1996J fCfc^T, ~aiM£(Di/-fr>XXhZ-? 

*??7&%H^zmtfr#mwe j fMz^x, 

jfcfifctlU© (16) 5t£ffl^T, %ht><0'<7* — 

?mwx%z^mmm*^Lx^zi\ %m (1 
e) si*, nmtT j v*/i<wKm*m*ximir& z 

[0 0 10] #»H©ittttK±0ra»ft«:j!RfcU ft 
AWfcfcfcgfcgas&tK TO^©^ 

30 R ^tf^aM^x^«gSX^^«mSrS« 
[00 11] 

m\mx hZ's-try* *^txAt} t~ 9 V ^T, 

^r^ft © g ^ic n , m <d mm ^s^f^Ai, 

y ^ 7 s > §r 5 *EH-«j fr y * ^ 
40 fffcot, ±EA7Jx-^tS^V^-r, ^fe^feb^ 

5? Lfc t # OftSfl!f«*©ii*#*/h t ft 5 i 5 t-e- 
VLX&?yx<Dmmi^*miLX^}b&}bbfttd!k 

x ic^stis mfem t , 5>g $ ftfc ^ 7 ^ ©*f*## © 

*fi?IJ©«Jf ft* t , »S § fotz ? 7 X R©/^ {f 7 A 

50 ©«g5t«^lf^LTtt)/jt55jWS>, ±E#SI& 



#1 t , #§t * fotz ? 7 * (omm <Dmm<om.mm 

t „ #§i $ fotc 7 7 7 IN] GVW ^ 7 A ©glgfit* fc (CIS 

J-^tMKu ::t\ 7*17— k • /<y$y— K7 
^Jttfcilfa? t D #5&3^roym^?Jfc*ft3 

loo i 2] sfc, mm\^y~ f ry^7^mm 
©a^w©f- 7 * B*t s r t t 

t*. 

[ooi3] Sfefc, ±E^f+i^>-7-y7^>£$ 

■cfHR$nfc±l^^ ^7 AG>*flaWli:*^-C\ 7* 
T^yTA^yXA&fflvvt, ±fle«3S:<0* 7*fc$HSI 
tS^fcflHKirtS. 

[0 0 l 4] IS&mtfyi'-'tri'ttf'A&m 

mmxhzw, 2 (D^ii^ij^B i omm\m< t # © 

A^r 7 fcfc it 5 fea^ro# >WJ K*t t-ctwt 

%\ h%2<nwm*tts~*>'<x<r>*>f *v 
MkT<D±g<Z)fn^ mi <Z)Wi?iJ£^trf-<T©i?7* 

fc-C© jfca©fPT?BJ|Et 5 r t <t ot# bft 
5 0 CirT\ ±E£«, ±EA7J7-7^*5^T 

#W^M£t5¥^@*£*t#«i > ±MAt)T 

#¥fu?ij[^t5¥^@ic^t^t £t U ±E# 

mmmmmomtmrnt Ltzt^ommt 
momsmmt, ±E8#±gw&<0fin?*>0, ±e# 

mmmommmmttm tLtztz ot^tro 

[0 0 15] ±E^ff-^^-7-y7^x>^ 

fcHlfeig t tz t # 5 r t i 1 3„ 



[00 16] St *38(flK:«5*inH-ttWt7*/v^ 

K*fVK-fe5: fc t5. 
[0 0 17] *^i^5^l+Wfl-fg^T>4 

io H7v-x-efcD, ±E^S^S«, miS?iJSr«i:o7 

mmmfcz'fA'-ehzz. t *m$kt ts. 

[0 0 18] ifc^&t, *3S1^5|f^S«^11 
ii, A7J^i^6^^ioWf^ici^v^-C, MS 
©^f+W-t^7V^|^fflv^Tt^Emt5^^it^g 

WwS*x>Sr#.BS LTW^SRt 4 - t Sr«f» h t 
5. 

20 [0019] 

mmommmm] sir, mmmhx*%mm 
^mmm^^xmmt^o urommmm^^x 

It* W-tiLitX^Xh"), X^^y-srVKXhiX^-n 
Sr^BfMtdlBtS-W* tfet;(c, ^fe{4#lST*& 9 , 
*M©i/-7-y7TfcS^fg?IJ^7WX (^) Kftm 
tS-WKoV^rRWL-CV^S^ *HKf4ilxt|5Ib 
■fx *ffittDNAT?fcD^ DNA©">-7>Xtfc5D 
N A?8*gf «©D N AE?IJ{t^t 5 i 5 iC*fi)c LT t 

30 %i&mmmi£<D^ vy\cftMt%i?mi&Lxi>t 

[ 0 0 2 0 ] El l (4, *3BWU:ffi5-iaigg«[^*)5it 
*y^RAM3 OSrfflV^ Wlfi»^-f — ^/V^-9'7 

^(D^m^y^^m-^m^^m^r^im 2 0 
^iix., seh-Wwis^t/^^ 2 0 ©^a 

40 nyXi.^^fc«l (7r->7°S3) - 
T^^7A«:fflV^Wflg&a (7r^7"S4) 

[0 0 2 1] tft*?*», #mfi7&H©ifctWTO*7\rt' 

7->7^^^A7Jr-^^c^^v^T, ^m<Dmm 

^ ^7 a -efe z>'<4 - ?7i>> nmfrttmm^Tfr 
^±m-^mmm^7^^m.xh 0 , 

H3K*tJ:5t, (a) ±EA7J7-^£X<J^T, 
50 i^fe^fefeixfcN,, N2<Z)^e»ftS*#WfciT:\ 



(5) 

9 

**mfr%mwm. (^t-^s2) t, (b) ± 
mmcm^x, &?y*(Dm-?-vLt~kz<Dwz. 

If t %Z> X 5 \z-?-VLX£* 7X© 

UBAts^MUfy^sa) t, (c) ±15 10 
&m&\z i o t# bti/fc^s $ tifc * 7 * its* ns 

t vmmx*miz.ttTm%±&k\cm^x>s~ 20 

^y^B©/V^9Ao«j**t*i-S (»2 2-» 

24) m^x, mis-'ryxmn'V ?7J»<Dm. 

^—^/^^y^m^^y-y-y^f^ir^LX 

mirrmmfefam Uf-;/s4) (d) ±ie# 

[0 0 2 2] *Mffi&nX\^ mVN- gramlCl 

<5<#fefc»fiit5, 7V-XfclKJ<*ifeK:j»jfi*S 30 
MSN-gi am|rS<5<i\ 7 W-XicX^X ^KM 

v^na^ttta-rs. 7 # 

«£tt(«©;Sc©«fffgJlroiSl* $ Srii ex 7 u-Xfc 

X" a b c" i$7V- Xt LTSfik^tlTVi^t^ 
fr?>1\ X^M^gJWRfi [ ab ] [c] ift 

^ fltsw^fe-cfia, b, ct'^to^^aaii^ 

TVT^ -7 7C7WX [a be] ©ffimt^^tl 

5 0 

[0 0 2 3] *HJ6^liTfl4, ^tf-WWIS^x/V 

7>M» /M-7/vf^7A^f^tHtT$^ HSR 
/<>f fi^yy ^(DW^yMi, 7 v-X|c*<5< 

[0 0 2 4] ST, •v/uf^AOSI&ttftJfcitfcfco* 



#fF3 0 04 2 5 4 

10 

1*2] W=w„, v . -w m 

lis W€nt^nflO*ffii»t>45#*07WX 

#88 (~>-7^) Lfci©ifi£$tis 0 

SliT,fl»7l/-X^<D1?7V>Mfc£*U si,, [4 
b©^P7/t«#t*f. ) (t) 07V-Xafc» 

[fc3] (W, S) =so) -sw 

[0025] -t^yhfls*nfc«3R©7U- 
XA>t>fc5S?*«:, fg*^£>l, 2-a»bnfcivfc5* 

14, ^C©i5t*l- 0 

Hfc4] Ds= { Sj } , 

k Lt, ftaoiSfcthBSftS. 

[0 0 2 6] 
[ft5] 

L (W) = £ L (W, S) 
SG {S} 

[0027] *f;wftSfi^fe¥S!: i 9 , iwii, 

[0 0 2 8] 
[*6] 

L* (W) =ma x L (W, S) 
SG {S} 

[0 0 2 9] 7l/-X^©n-gram©til 

[0 0 3 0] 
[ft 7] 

L (W, S) =np (s n > I 



[0031] jy.Ts ^nf±«»:ro7>-xra 

Wft#j££JlU «<Z)n-g r amWSffifeOniL 

a-f 0 lot, ^r-e, ±&otfirmfc£ic*-r. n 

O^il-Cii, /^-^^yAtfA' (n« =3, n 
= 2) ©" a b c d" 

[0 0 3 2] 
[»8] 



(6) #fF 3 0 0 4 2 5 4 

11 12 
= p([a] |#)p([b] | [a])p([c] | [b])p([d] | [c]) 
+ p( [a]. | #)p( [b] | [a] )p( [cd] | [b] ) 
+ p( [a] | #)p( [be] | [a] )p( [d] | [be] ) 
+ p( [a] | #)p( [bed] | [a] ) 
+ p( [a b] | #)p( [c] | [a b] )p( [d] | [c] ) 
+p( [a b] | #)p( [c d] | [a b] ) 
+ p( [a b c] | #)p( [d] | [a b c] ) 

[0033] ±.mmfrhmbfrt£t 5t, m±& * @<D±y wmmmx ^^t^-^^bm 

ii, *s*-<tryx" abed" > MtfS t %<d 5>ft3fi£L 5 i-ftbhMc±mm$. 

t^X<Dm&&trikKL^X<Dmg&*<Dfn&&LX^ 10 (Maximum Likelihood Estimation) tLX%btl,Z 

[0034] w£7 t w*y/~-*<Dmfe£. So tot, ;<7 &<DKmwM±mfemt, & 

oV^Tfi^-fSo ^f^AOn-gramtf^ ftJOEMTA'^y XA (Expectation Maximization Alg 

Sro/N°7^-^0(i, S¥#Ds£ffl^T, (k, k + i) SS0S^7/^kWk + lO 

1*9] mm^xmzhz, v&nmm&ti-z. 

9= {p (sk I s ii ••• sw ) | sn - Si, £D s ) [0 0 3 5] 

nfl©7U-X©fcfei$>5Jra£i7£fcH«1-5n-g [»10] 

Q (k, k+1) = 2 L l " (SIW) log {L u+ " (W, S) } 
Se {S} 



[0 0 3 6] ^OEMT/^y Xi^fc^-OT^ftS 
[jjfcl 1] Q (k, k + 1) (k, k) 

-efcftii, 

mi 2] L <W> (W) ^L <W (W) 

xh%o lot, mmW'<7*~? (k + i) wart 

[»13l p <k *" (s, I s ii -s« ) 3i 

ii, ftstoftjidkfr 

[*14] X 

P U+ " (S,. I S,i-S,,-i) 

= P./Pi, 

p.= {X c (Si 
Se {S} 



2 P (Si, 

Si.eD, 



Q (k, k + l) fr**fti-5CfclJ:J;9» 

[0 0 3 7] 
[ftl 5] 



Pi,= { X c (Sii-s,, 
Se {S} 



lS ,., S) XL (l) (S|W)} 



S) XL 111 (SIW)} 



[0 0 3 8] r:t, c (s« - Sin , S) ii, 
^hftSK:jSlt5*«07V-Xsii - Si, 0>a*-&*> 
*©W^IRSr*1-. mi 5©ffft£S{i, 

(n = 2) toV^TBtt!l»*il4±5K:, 7* 
!7- K • /<y * 7- KT/U^U (forward backward 

algorithm) (WT, FBffit feV5 0 ) £fflV^Hfr£ 
ft5„ SUtfcifctt, ifoS»J;5ic 

ffiB&fc£ft5o 

[0 0 3 9] 

[&1 6] p M ( Si „ - Si „-, ) = <C ( Sil -S 



« S in , S*" ) } / {c (sn -s.« rt , 

s" k) ) } 

[0040] s* (k> ii, L <k) (s|w) 

ft-rSXro^WSST-fe^, tT^tr (Viterbi) 7JVd 
!JX.M£.fcoT*iWi5. ±gL (k) (W) 

I'ttttJMi (i3-tf><{i, ^BHfcfctt) ^Hsofcta. 

h^mm^Ts hT-fizte^xm^tshz-f^xtD? 



(7) 

13 

5 0 * 
[0 0 4 1] #Cl^T\ Wffi7WX©^7X?py^ 

£L-0^ 0 ftMtfJt^, 4$igfi41\ ¥i&#JR1-5 

/W^Iff7k-X [C k , , C k2 -Cn ] 
#Bj^ft7l/-X^J;oT, "< [C k , , C k2 ■•■&. ] 
>" i LT*$tl57l/-X^MtS^7^W7-</^ 10 
5tS£ft5 0 L^Uj^b, ro^ST'tt, [WlCfiS© 
7 l^-XO^|; L/H^ C7 W-X-? 7* 7^£fl 
S"C5Ct^T'#^V\ flijxff, " thank you for" 
t" thank you very much for" i l" 1 5 7 V — X£[r] C 
^ 7 * 7 ^/WcfiJ 9 S T 5 r t tf* T* # ft v \ *Hi|^l 

5„ r©lWSr^-t-5fc»tf±, 2|B<D7Ix-X^© 
^/7AOtil (n.„ =2) £{E£U ±mLtz;< 
4-^)V^^yK^T^<D^m^\tm.^7L, #S 20 

[0 0 4 2] (I) Xf^SS 1 : ^7^#J?)ST 
(H3 0^fy^S 3fc*f*S1-5. ) * 
L (W, S) 

= n p (Ckc.CD) I Cu.d-: 



#fF3 0 0 4 2 5 4 

14 

I«C1 71 {p' l> (s, | si) } -» {p" (C»«, 
I C kW , ) , p W ( S j | Ch* ) } 
(II) 7xV7°SS2 :V/^^7A©||«S (El 3 

o^7j'7 p S4l:»jet5. ) 

1*18] {p" (C kW , I C k(si , ) , p' kl ( SJ 
I C kW , ) } -> {p <kn ' (sj | Si) } 
[0 0 4 3] iExfy7"SSim 7U-X/^^ 

Ifc 5 Tp. F. Brown et al. , " Class-based n-gram mod 
els of natural language" .Computational Linguistic 
s, Vol. 18, No. 4, pp. 467-479,1992] Kifttf, R<9£5 
7 XH ©ft Iff $ fc 1 5 r t \C i. o Xfibfo 

z> 0 ^7^^y >^o»±¥M^ii/ c e<7w 

-xfT5„ ±a©i5fc, {p (0 ' (sj i si) } 

it, ^Ifflr^rX hr-^t*5(t5 7^-X(0|WlBtt±iS 
©ft»WS££ffl^mWt:£ti3 0 ±fB7r s/7°S S 

2x-ix •?M-?7J»<nmmfe& »is) xi«©;e 

ffil55 (#16) tffiV^T7l'-X©«jat**SitJ&t 

[0 0 4 4] 
[ftl 9] 

>)) P (s (1 , I Ck.co)) 



[0 0 4 5] zhit, ±a£Lfc«fc5fc, «»*p (t) 
(sj I Si) KStt-S&Sili^K, MSWp 

*' (C kW , I C k(s „ ) Xp W (s, I C k(sJ , ) \cm 30 

^xmmmp^ ( SJ i s .) fcrnts-rsri 

[ 0 0 4 6 J Sft+tutf, lEX7->7"SSliao 
T, m£©7U-X#*t&iU TOfff«©S*tS 
<5 < * 7 x$ iJ "9 S T riSftSf k £ft 5 <£ 5 f*tE § ft, ±12 
X7^7SS2iaot, SSE©*7*0*WS«*fli 
V^T, JiEfCl 9KoT, th*Snfc±^7U- X 

(paradigmatic) ^ogc-^lft (syntagmatic) (^tt-f 40 

tl5 7 ^-X^©S^^)l#i47 l^-X©«S*J(S©|f 

*S£fc#«£4ai, yv-xnmmmwmhvy 

[0 0 4 7] ±$©J:?l£, /<>f— v 

jVj->fy&<r>Ay*-9<D&fe<Dltlh\^ 7*?— Y • 

[0 0 4 8] JiESl 5(4, 7*>7"K-/<2/^!7"K 50 



n.„ ^i/-7y^O*7Cfii 
L s TSr3-/>x (f?ffl7^r^ Fr-^) tofflkkL 
X, Wt&£<D&£^X'h?>^y7°U*i'T j O (n- 2 

t) -ew-f-rsrt^-etSo ::t\ a^v^ 

(n ra> 2 T) 

tfcfct, awfci 5©wj|3^htt, -7^>x©i 

7<fin„» »2SiCJt0iJL, 3-/<^©|gftK:H:«1- 
5 0 *HlS^IHi*JV^TH:, t^7Mk 
{s} ©-fcyh-eHt4<» fio^^'A-fyfj'^x 
(t) (c^fcoTJP^SrffV\ Sl5©7>fM7)f^ 

(t, I,) Xt«ft5*fii©«»/J (t, lj) 

[0 0 4 9] 
[*2 0] 

a (t, h) =L (Wo, <t " 1 " | 
[W (t -H.„ M ] ) 
[ft 2 1] 

|3 ( t , 1 j ) = L (Wcw) m | [W,,-!,-, ] ) 

[0 0 5 0] M7J^l©« a (t, 10 14, mWt 

II577^©ti:i3 (t, ft^© (T-t) fi 



(8) 



*5fF 3 0 0 4 2 5 A 



15 



0s&©£#f+#;C;g*r*U ftfe© (T-t) fico^fg *5 0 

14, [ww«) -ww ] r [0 0.5 1] 

:t\ Woj <t_,i) (4, Wvfyn [fc2 2] P ' w) 

(i) «»6 (t-i.) 4-e©¥R*»e>fts*lS5!lta 

1% "t LTv fl?«fS*©±aii, $k7lCl^xmZ*l [*2 3] 

Sfel 5H*3t0>,fc5l;:##iM.e>ft * 
T 

P«=2o(t, l,)p a) ( Sj I Si)0(t + l Jf 1 1 > t < t — 

1) 

t = l 



(Sj I S.) = P c/ Pd 



[#2 4] 



P,=Z a (t, 1.) 0 (t, 1.) 5, (t-1, + 1) 



[0 0 5 2] i;t% i i AIM j tttfi-Wii'— fr-^* 2 
s.Xt;sjO**t*i- 0 *n*y#H»*«i (t) 

**H*"e*>5. 4fc, £&«&tf0fiEJlT0K«a; *20 
a (t, 1.) 



[0 0 5 3] l^t^T+lfcftLT : 
[*2 5] 



2 a (t-l„ 1) P ( [W (t - )1+ i) to ] I [W(»- 



[»26] a (0, 1) = 

(0, n- ) =0 



a (0, 2) =-= a [0 0 5 4] 0 ^ t STiC^LT : 

★ [»2 7] 



0 (t, 1,) 

= 2 P ( [W (1+1) (,+1) ] | [W (t - ll+1 > (,) ] ) J3 (t + 1, 1) 
1 = 1 



[$C28] j3 (T+1, 1) =1, 0 (T+1, 2) = 
-=0 (T+1, n.„ ) =0 

[0 0 5 5] «*fg*©±giS^7^rofi£SrfflV^Tt|- 

£i4, StlSS (»2 2-*2 4) ©«p M (si I s 
.) i4^©^7*<Z>^«l, 1-*J3*>p W (C kW) | 
C k(si , ) p lt> ( SJ | Ckwi ) i-^t^^b^X^o a 
OSttatfcfcl^ II p ( [Wa-iM ] | [W 

ft-IH.ll M " ] ) tt, <>— fr^* 

[0 0 5 6] *3HfiJg||{r*5tt57*I7- K • 

/<y* 17- KT/u=f JJ XASrfflt^S«S»aico^ 



2©^©jp», RTMm<DM$w. ftmwffi&sm 

£ {S} fcffcboT* *Sf*-^tteH-5*4t©i*a>f 
yxy^^tfcoV^tf^^tbSi?^ icl 5icfcl7 

(a) TE0^7^7 7«Al»T1t fyWfc 

(b) TB0^7^77«A1. l>>Ti4 % 

(c) TE©/<7^77«A1. 2>>T!4, »a 

(d) TE0^7^77«A1. 3>>T'i4, 
(XttfiMfi) lc45»a i 0<0ff3f#fc{CilLT0J* 

(e) 7EC0^7^77<<A2>>-e(4, pyX&ft 



(9) #1^3 0 0 4 2 5 4 

17 18 
4-f5^C0'^7^77<<Al. 2>>S.^<<A *TV^ 0 
1 . 3 > >©* JE^feSr^-r., [0 0 5 7] 

(f) TtW^-f^T, ^©SC/Tff-^tlo^* 



onesixone e i g h t s i x t h r e e t w o 
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 



[0 0 5 8] «A1. l»ffijjfa<D£&.aRXm*> 

fta (t, 1) {4, ft£ 1 (D^-fr>XX*mi- -5, 
W^fy^ (t) Stof-^©±St*fe5„ $ 

X.f4\ ggjfto (9, 3) f4, y-^y* To ne s i x o 
_n_ej ©jfcft-CfcS. tit, mk& (t, 1) ft, fi£ 
lW^-^J^iWSISkyfV** ( t ) -CUTtSi 
v^cfctffcifeih/T^Sfctfc, nn^yrv^^ (t 

If, £ftj3 (9, 3) i4, Steff^S*— {ry;*# r 0 _ n _ 

ej t-fe^tt©, T e i g h t s i x t h r 

e e tw oj <D±&1*kZ 9 ^XttflMfciSlEfta 

Xtf j3 otW*ifeK:H1-5Wt, TE©^7^7 7 < < 
Al. 3>>fc*t-. 

[0 0 5 9] «A1. 2>>'lftaRt/|3(cSo<5t 
SrftfflLfcjggflt^p (o_n_e | s_i_x) 

to mmm P (o_ n _ e i s _i_ x ) ©-m&mt^ 

(fti 5)) fi&©J:$4*!**«ro. 

(a) #7(4, ^ST^fcjS^Tf— fr^* r 0 _n_ 
ej ^y-7-y* r s _i_ X j tiR<5F4S|5|»-cat,5. 

(b) ^shc, ^T-*t:}oi^y-<7-y;* r s _i_ 

xj #&4-t5¥#0j»rCiii>5 o 

(c) ¥*&[ni$:©ttf4, fif-^o^-^y 

* t *5i7 5*-<T <mffim *f g^ri-ov 5 0 
[0 0 6 0] 7*7— K • /<y?7- YTJVd ]} XA£ 
J8^fcS«t£5£ (S2 2-2 4) (ft2 3) XV 

5}-* (ft 2 4) tt«t-«l, ftl 5©&*ftt«)#fc:« 

y-r y * * KifcfcSJWIK: £ o Ttt* Ufc % ©T* 
&5 0 ffft^S (mi 5) ©#?-Ti4, r s _i_ x j t r 0 

_n_ej 0 2j60^-yy^asSJgLTfS4-t-5S{-, # 

•A^^y-KT^^yXASrfflV^H*^ (ft 2 2 
-ft2 4) iC*JV>TI4, r s _i_xj i r 0 _n_ej ©2fi© 

y-7-y^i«iLT3&4U ->-^y7 r 0 _ n _ 
ej y^- y ^ * ( t + 1 ) -en#t3 i 5 &t 



[0 0 6 1 ] ±E»MT(4, r s _i_ x j r 0 _n_ej © 2 
r 0 _n_ej W^yn (7) "MWWJM&L't^ 

5 0 r s _i_ x j fc r 0 _ n _ej ©2fi©->- ^y* 

2SiI^UT3§4U mi^yfy^^ (7) -c?/ 
r 0 _n_ej ^BJM-SiSftl-^TOjWffJS* 

©;£S'filGD?nf4, v— fone s_i_x o_n_e e i 

ghtsixthreetwoj ©;£^T*fc>9, r*U4, 

20 ft*R:<pu\ 

112 9] 

(k) 

a (6, 3) xp (o_n_e I s_i_j) X0 (9, 3) 

[0 0 6 2] lit, H2Jf©p (o_n_e I s_i_x) 14, 

(k) \z.mz>mmm-Qhz>« * 

fc, mmmWa<Dm^£V, fta (6, 3) 14 
y-^y* r 0 n e s_i_xj ©jfcft-CfctK Sfefc, ft 
^Fft<7»:/3©/£iS(;:i<9, &ft0 (9, 3) 14, > 
30 -7-y* r 0 _n_ej ^fbtifctf ©, ->-^y7 T e i 
ghtsixthreetwoj <D$:&.fhZ>o 
[ 0 0 6 3 ] ft 1 5 ©#«T*J4, BTlB4#**fft*©* 

->-7^7 r s _i_ x j ^©flWrfcfcvvt**-*- 

5©tKC0ft7M-f5 o 7*7-K- 
14, y— ?-y* r s _i_xj #3&£U B#SR VfytT. 

(t) ^7-r5t^-c©^tfgm©±se^*T^ 

^-7ft Lfc^i« L, B#£iH 7 ^ t SrS^fc 
l**t?JDj|[*|lTi-5. 
40 [0 0 6 4] ±iE©^jTi4, ->-7>7 r s _i_xj (4,. 

wvTyn (6) bmnyfytx (17) -c 

^T-r5J;5[-IS4LTV^5 0 ^^-yx r s _i_ x j & 
11^7^7 (6) T-HTl-?>J:5('%4*5't'< 

x<DMw$$k<D±mmMmx y-^y^ r 0 n e s _ 

i_x o_n_e eightsixthreetwoj CDTClS 

[0 0 6 5] 
Ift3 0] 



50 



(10) 

19 

(k) 

a (6, 3) xp (o_n_e |s_i_x) xj3 (9, 3) 

[0 0 6 6] mjjfa<Dm$ka<Dfemiz-£*). £ 

IU (6, 3) tt^—Jry* To ne s_i_xj (D±S.X'h 
<9, «5*lRj«>«»/JOS*lfcJ;D, (9, 3) 

ti, v-^y^ r 0 _ n _ej fcftfci:* o, 

Te i g h t s i x t hr e e t w oj <D±&X°& * 
(k) 

a (1 7, 3) xp (tji_r_ej 



WHF 3004254 

20 

5 0 

[0 0 6 7] Wyfyn (1 7) icfc^ 

±iSttCDi)O^I4, : y—>ryX To n e s i x o n e e i 
g ht s_i_x t_h_r_e_e t w oj ©±^T*fe"9, rtUift 

[0 0 6 8] 
[ft 3 1] 

|s_ijt) XJ3 (2 2, 5) 



[0069] rrt?, i(r*iRi©aafcoosaiu:j:!j, % ^ [0071] 

W.a (17, 3) (i^-^y^ Ton e s i x o n e e i [^32] 
g h t s_i_xj <D±&X>h*) s &Zjjfa<OmLfi<D%m (k+1) 

fflfcfl (2 2, 5) ft, ~>->r^ r t _h_r_e_ P <0_n_e I S_U> = p./p, 

ej «s4ibixfci:#©, y-^-y* rtwoj o±g-e 

[0 0 7 0] ftoT, To n e s i x o n e e i g h t [&3 3] 

s i x t h r e e t w oj ft 5 5*19*-* fcfctt*, S (k) 
Mb^-* (k + l) fc*ma*S**p(o_a_e 20 »• = « < 6 > 3 > X P <0J_e|»Jj) xfl (9, 3) 

X£*Hv\fcffli^»i&a©J:5fc:4a. * [#3 4] 

Pj 

(k) 

= a (6, 3) Xp (o_n_e I s_i_x) X0 (9, 3) 
(k) 

+ a (17, 3) xp (t _h_r_e_e I s_ij0 XjJ (2 2, 5) 



[0 0 7 2] &,m® LtcX 5 fc, *ISKW|llfi^lH- 
£ffiWT, jfc2 3XlJ*2 4fc-at*2 2*fcSfcW: 

■C* "9 , ±E5'-* y * IBGW * 7 A 

mi if^J^J^trf^-co-feTVy Mfc?©± 
i£<D?nS:, |§ 1 W£?iJ£^trf -<T<Di??V y MbT- 



[007 3] «A1. 3>>fl&#fl©«ft B i:f|5# 

#iJt LT N T— * ionesixoneeightsi 
x t h r e e t w oj (CO^T'liU (9, 3) 
0 (9, 3) SrSATfcH-S-J-S. -iTf, 3E»o (9, 
3) 11, -y-^TVT. To n e s i x o_n_ej <D±&X-fo 

yyx-cfeoT, ft^Stfcv^Tft^ 3©f— {ry*& 

rf6o g&0 (9, 3) IX >y~>TV* r 0 _n_ 

ej & J 3-K.bfotib$ <D^ i/— try 7s r e -i g h t s i x 
threetwoj ©&ftot±gT*fc »9 , :0~>-^ 

y*tt, W yf -7 ^ ^ 9^o^^^^tfeo 

T, m^y-'TVTs" 0 _n_e" li^fcfc bft"^ 
5. 

[0 0 7 4] y-^yX' o_n_e" £X*<D±g. (itfcfr© 

II) a (9, 3) 11, SilS. 4*5, *>- 

7->^ (JRBI) 5" \cmfeLtzM& 

[»3 5] « o, 3) =rm<DMm 

(a) n_e_s_i_xlCOV^ : a (6, 5) Xp (o_n_e | 
n_e_s_i_x) 

(b) e_s_i_xiCOV^T : a (6, 4) Xp (o_n_e | e_ 



(11) 

21 

s_i_x) 

(c) s_i_x\C1^X : a (6, 3) Xp (o_n_e | s_i_ 

x) 

(d) LxfCOV^T: a (6, 2) Xp (o_n_e | i_x) 

(e) xdol^Tra (6, l) Xp (o_n_e | x) 

[0 0 7 5] v'-^y*" o_n_e" ©^#0^ t"e©-t 
(m<Dmm 0 (9, 3) »i, iforeft 

lie 3 e] j3 o, 3) =Tmmmu 

(a) e_i_g_h_ti-oV^T : p (e_i_g_h_t | o_n_e) X 10 
jS (9 + 5, 5) (b) e_i_g_hfcolvT : p (e_i_g_h 
I o_n_e) Xj3 (9 + 4, 4) (c) e _i_gi'oV^T : p 
(e_i_g | o_n_e) X /3 (9 + 3, 3) (d) e.if'O^ 
X : p (e_i | o_n_e) X j3 ( 9 + 2 , 2 ) 
■(e) efco^T : p (e | o_n_e) X 0 (9 + 1, 1) 
[0 0 7 6] <<A2»^7^©*i 

( a ) p (o_n_e | n_e_s_i_x) (4, p (class of o_n_e 20 
I class of n_e_s_i_x) X p (o_n_e | class of o_n_ 

e) t^XmZtifoZo 

(b) p (o_n_e | e_s_i_x) f±, p (class of o_n_e 
I class of e_s_i_x) X p (o_n_e | class of o_n_ 

e) ilotftx^5„ (c) p (o_n_e | s_i_x) 
lt s p (class of o_n_e | class of s_i_x) X p (o_n_ 
e | class of o_n_e) bW-oX^X.hh^ Q 

(d) p (o_n_e | i_x) (i, p (class of o_n_e | clas 
s of i_x) X p (o_n_e | class of o_n_e) tStotft 
X.fetl5 0 30 

(e) p (o_n_e | x) (i, p (class of o_n_e | class 
of x) X p (o_n_e | class of o_n_e) rtoTlx.?) 

( f ) p (e_i_g_h_t | o_n_e) (i, p (class of e_i_g 
_h_t | class of o_n_e) X p (e_i_g_h_t | class of e_ 
i_g_h_t) kftoX&ZbflZ. 

(g) P (e _i_g_h | o_n_e) (1, p (class of e_i_g_h 
I class of o_n_e) X p (e_i_g_h | class of e _i_g_ 

h) iSoTglxbixSo 

(h) p (e_i_g | o_n_e) \X P (class of e_i_g | cl 40 
ass of o_n_e) X p (e_i_g | class of e_i_g) ilXo 

( i ) p (e_i | o_n_e) 11, p (class of e_i | class 
of o_n_e) Xp (ej j class of e_i) b^-oX^kz.b 

( j ) P (e | o_n_e) ft, p (class of e | class of o 
_n_e) X p (e | class of e) b &ot^X. btlZo 

[0077] <mvrmm^f/^^m>m3ix m 

f+Wt1g*T>£j&^ffi£*-f 7n-f--t- VXhZo 50 
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mmwm^T^m^2 oft, HHJ^rfJ: 
b\z s Hk<D/^V 3 17553 6\cm£htz9~*>? 
RAM 3 0 £H5ix.<5„ 

(a) /w-***y 3 1 : ^m±^mx^m 

*<DmiE;<yt-?mmtZ>t : £ ] )XhZ> 0 

(b) =y-' yv^W&W&t^V 3 2 : tmSftfcfcS' 

~&v*<DM.mm*mm-% * * y •<•*>*. 

(c) ?y*%.m**V 3 3 :«JE$ftfc#^5^fc* 

(d) ^7X|M^Mi^*!i3 4 :*t££i-lfc 

( e ) t7X'uy7&m8&k&**y 3 5 : ^7^0 
77 j»mmmm-t 5 ^ * y xh s 0 

(f ) *^i/Mk**lfc'>-^^^*y 3 6 : ffit 

isti-f3^y-ek5 0 

[0 0 7 8] H3fc*5l*T, £1\ 7^y7°SlX\±, 
fffflf^h7-^^y 2 i^f>r**b7-*£ 

\±, mmmmi(D^-^>7XhV) , ^^x% mtt 

HSiWeibS. tit, ^fcTEroA*/^-*** 

Rjesft-cv^-^^y 3 lWEttteft-cv^. 

(a) y-^y^Ot^g (*ttOjRT*t. ) , 

(b) ffit£&ai^7*it (c) ns§t5f-7- 

4ic©ft/MB) , &iMd) liltt. ^7^ 
#Hu ttfcli, Rttl§lftk©L#Hin?*>5 0 

[0 0 7 9] &V^T\ /r-y/S2T\ 

1-5. ±EK^S*ifc«idt5i/-^y^j«c©L 
[0 0 8 0] &1>T% 7x:y7S 3 T*ii s UVVTA' 
ft^X^VT, ^ 7^IB]<0tB2tira*(7)S^*/hi: 

a, ^ 7x»w# 7 7^f B io->-^x^©Mi$, 

RU? 7 ?7 ^tDM&mmmW-LXZh^h/ 

^y 3 2 755 3 5fcffi*LTEt|-t5. rro&atfcMt 
t7;W'!)XA!t *^5¥ffi©*&fc#LT\ 7*7 
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[0 0 8 l]ft^T% ^X5'7 B S4(C^3V^T, 7*!7~ 
K • /< v 9 V- K7A- dt y §r#BB lt# bftfcifc 2 
2-f£2 4«rffl^T, /M— ?/^^7A^^fcSi 

Tf+^S^ KM^°7^-^k©i#©, ^7* 

&i^7*/^^7A©§tg**!^^vr, #c© 

(k + 1) Oit©, ^y^©«t***ifit£ 
LtH-f Lt, y^JJ 3 2fcHtfjLTB1fr*-$. 

1-*^*>, «fc©^-7-y*©^7*i^^7i>©$ 
#ttSrteLTtt^$tlfc»tfg*©±S©^©ft*fi 

xhz>fk±mfemmmmtLxm^z.kxhv , s 

[0 0 8 2] ft^T\ *7j/7°S5-C% 0fS©HT*fl= 20 
Srffl»ai-5^A^J»r§n, NO©fc#tt, *T77° 
S 6 -CK« |SHfc/< y / - * k & 1 £ *M > 9 y J/ h L 
W7y/S 3JttJtS4©ftm**t)fi1-. *T 
y:/S5-?YES-e*>*Uf, ^SftfcifcttttmB*?* 
/u©7*-* ^f^st^T/M * y 2 2 iCtti^J LTI5 
tS-fS. 4/££ftfc^ffftwM*T>©r~? 

Aftttfctt, T!E©T~*T*fc3 0 

(a) A;&S*ifc7*-*£*#©S/-^y;^i:^y 

9 ; 

(b) ^7*£JS, 1-£fr*>, #*9*fc*5tt55"-*- 
; 

(c) ^7 *©§«*, 1-ftt>*>, &tyx<W? 
[0 0 8 3] H4f±, mS<D-f7*/V-=?->X'h%-7'7$ 

(^x.«, «*R»»5#,ii 0 ) #ftH£*i-ei8!K 40 

rtiWSts,, /7^f)lt 
©±S£i:Afct^7*-©7>im£i?^:/ Mb 



#FF3 0 0 4 2 5 4 

, 24 

*^vMfrCi>*>5::ifc*L-CV^ 0 «bli^f&© 

7^^**a*'t5*flk47A'=?y X A (greedy algori 
ttoOfcJBBL-C^S. #SS9!#f4, A^iLTA 

yx©/q^7A©|git$©M) ^ftffi-rsrtic 

7^^©-fe^ y Mk&tH:©£^— 

[0 0 8 4] r©#S^3TfflV^fBZli$fcl£J3l^;: 

^m©^ 7^^ y y^oi>mwji-f?> 

*WJK, pp. 110-11 3, 199 6^11^15 

zmk-o^mmtz. nsfsiti^<^7x^y 

m*ZMc±£tZl:o%t7xmQ%X-?kZZ}: 
T^fcH:, ftiS©*?^ ¥IS©^7X©N-g r am 
-g r am££fat5W!S^7>©;ii7;'fc3(;:©5£ 

it, 7 x*&m\m%&z-titt, %mmmm^ 

\-jimAU<D^bmzKt£h 0 lot, ^©^is^HS: 
3, 

[»3 7] P (w, | w," ) =P (w, | c.) P (c. 
I c*. " ) 

[0 0 8 5] *ISwi«:^7^c. 

«£1-<5„ ^Wr** M/^x^ftfci^ P (t 
| t.) =P (T, | T.) P (t, | t.) -P (t. | 

Oiyfof-H ( w ) , Rg1-5^7^©¥^ffiHt 

ui (c. ; c.) offlctt, mm\a!K&<D?mM 

[0 0 8 6] 
[$C38] 
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L (it) 

= (T-l) - 1 1 ogP <t, r I ti) 

= 2 (C (WiWt) } / (T-l) XlogP (Ct h'Ci) P (w t I Ct) 
Wi, w 2 

2 P ( Cl c 2 ) log {P (c 2 I Cl ) /P (c.) } 
Ci, c 2 

+ Z P (w) 1 ogP (w) 
w 

= 1 (d ; c 3 ) — H (w) 



[0 0 8 7] h (w) tt$MWieli:ft#Uevv6» 

b, L U) *r**^tt-5fc»KUi, I (c, ; ci) £ 

f47;W-!JXA (greedy algorithm) Tft, 

±51^ m* 1 9^fe/ < ev^^7^^^4^•rs*•&f4^ 20 

[0 0 8 8] &<7>#£-£V- infill" ^ f^T© 

1. 1-^<TO*ig(c#LT, -oro*7*fcf|!>3-C 

5 0 

2. ^4:io©*?*0»#£;btf©*T\ 

3. ^7 L y7'2^V-ClHl^t)S1-tCfi0^7^^ 30 

[0089] -jftt, *7**jWB**ft$agfc*-t- 

®l*5tf4flf^0 (dendrogram) iPMl^\ g^W 

( 1 ) zoo * 7 * * *r#& Ufc t § ©If 
frfcjfcfcfttf iV^fc*, (2) loW^y^^OM 

^t^Jfflftutf, O (V 3 ) (Dm, 40 

[0090] sni&a (xtt^ 7 x * y y y%m) 

1-04IC*5^T, *1\ *T-y7°Sl im M» 
^C.fcftl&STS. ftoT, ?7^©»^^7A 
It3 9] p (si | Ci) = 1 50 



■e*>5. 

[0 0 9 1 ] ftV^C, 1 2T\ #^7*©*j" 

(C k) Ci) ico^T, ?7^C> t^7^Ci t§rv- 

S 1 3T\ ffiS1fa*©a*iS*/h-e&5^?^©^«r 
v-v?i-5o -frLT, *T2/7"S14T\ ±B-r— 
Sot, ^y 3 4Xtf3 5fcB1t;*;h,fc*9*©*# 

a*©^^Hgrt5 0 ft^T\ 77-7/S 15t\ * 

r y 7° S 2 ©»{^irSS $ ftfc&Kfc VJT&fr 

7°S 1 2 ICR 9, ±IEO«yi«r»5St. ^ry 
7°S157;\ YES©t#(4, jc©^ ^ WP-fyCg. 
5 0 

[0 0 9 2] <t«18fi>#^T\ EI 1 m*f3fi» 

^mmmw<ommxmm^^xwm-r^ a w 1 1 

t> (WT, l^/l'37 ; ef>l:HMMi:V^. ) ^ 
^y 1 lrt©f*HMMB, #*t**£A/C*3*t; # 

(a) (b)^I»yr^^7 
(c)M«tS«Wo^K (d) tti 

^?t*M^©^7^-^ XV (e) gHB&SfigS 

mm&u 4 * y 1 2 i*i©i£igs¥ 

#tt, ^StHMM^y 1 1 ft<D#gfHMM©&i£Mfe 

in y *WT*S L * *1--> V #/H0J SrlMfrf 5 . 
[0 0 9 3] Hi fcfcVvC, Kf-©3&J*WfiW * n 

* y 1 fc A^J £ tir Wi^Kgife $ #®»tB 

S2tA*S^5„ #SfcttfflSS2f4 % A^jSnfcWf 

ft/<!7-, 16^7°^h7A» AMic/^!7-5.TJ? 
1 6 ft A ^7°X h 7 A«m?r^tf 3 4 *5cO#it^7 ^ 
-^^ttlii1-5o tttii$tlfc#m^7^-^»Bf^lJ{± 
/^777^^y 3^^LT^Sl^$K4(CA^$tl5 0 
[0 0 9 4] l£SJg'&954 li, 7>-A7 • t'^ tr^# 



(14) #fF 3004254 

27 28 

1-5. *!SO«SiJ##, ^MOl^^'J, 5fetT fc»«-f5jte^5*|g&&0'>ft< it loofft 

#1-5. ¥f&fi&£S|S4 ft, %(D®s%<Dmi5.mtm<D [0 0 9 8] EUiOHJfeJgfllfcio^T, #StttW«|5 2 

tta^^i^p^ij^fcwa^ttfa (Mfomnz, mz. io *i5i^4t, mmumm^U6t, mmnm 

tf7W-Atf) tfcfct^y^r^^y 5*r^UT* ^r>4j&a 2 0 i ii, #Ui4\ r v^H^tMft 

!&{RtftiRiilB5 6lcW^1-5. t*©=>y^^-^-e#^^tl> '<y77**!> 3, 5 

[0 0 9 5] 6 li, SMgfiitelSUia^ flHMM^ ^ y 1 1 i£l§Sf»^y 1 2 i\ 

si+^mis^Tvw y 2 2 rt©gtt^fi*fyv ^ * y 2 2 1 14, rnrn^- KrV ^ * / 1 y * or 

£#lbT, »7^*J^L<IBi6^^*5^-<7) 'lgtT*J5)cSix5. 

*f&©¥s&ffiuKt*ru-c, sa*iso3fest*ai«ES [0099] $x±mmm\zts^xtt s mm^U4 1 

JifcffctilEO 5 *>©*t*v^**t*i"* 1 oo^fifs #»WH:;:*tf;:|8k1\ tlHMM 1 1 

RTMt«**5i5K:¥ISfiRotS!9a*Srffofcft, 20 1-5t*RB£S£, 0J*.tfOn e Pass DPT/w 

S9^t©t^T©W£!£©¥^ij©5^ ^yXA^ffl^T|Ef+^ = fg^T^^#lLT^fg^ 

5. *iat»«t*SV^Tti, ff*L<l±, fta-f^tS [0 10 0] 

M£©f*t*^ 3K¥KO#IBfiRo*iD0 2oo >A7]£*i5^Wt-?;$\ ETF0J: 541 0 0 033= 

300^11^^ 5. nnm^xh'o, mixhz>x^frtb%-mK±?t>h 

[0 0 9 6] Mx.\f, H2{^tJ;5i^ (i-l)# flrtafcfcofl-efcs. 

i<7)jpfgW i ^*?IJa 1, a 2, -, an Tonesixoneeightfivezero 

frfcfcS iS@©*SWi^<5t#l:, ¥SWi-l ...J 

©liMfti U6o©fitWa, Wb, Wc, Wd, 30 ffiU ^©#S&©&fc:tt&1W0£i&#&lKU fl 

we, wf ##£1/0*5. rrf, ffj#3o©WK »©£f&o&l-tt&1*$&©£f&;as&»t5^T?& 

iWa, Wb, WcOft^5tfl4/x/-C&5t U « 5. SSH16fi»lt*5»j-5A*^7^-^H:WT©a5 

#3o©^iIlftWd, We, Wf (DS^^Ii/y/ fo5„ 

■C&5tt5. mmMt e t5feSI^W^tVMg (a) lfiOi/— {ry^O*^=5, (b)*7*«C 

m (m2x\tm^mm^ "x/ a i/ a 2" -?s>5 =2, &w ( c ) h*i-5'>-^^©l#vmb=i 0 

i2tfe^xisi©si) m&m®rt [0101] mimm (k = o) m fif-^t 

5. 4*5, ±^b4#fe(Z)W4^Sj ; | 1 JlW^5fc 10 0®&m*.XWLmL1tX^<Dt'<X<DlK& 

fe, 1-fcfr*>, 5fctTl-5^M£«i*^*^xm& *©ffi^W^W-ic{t^Wfii1-5. $oT, 

<y-efe5<0T\ ±*»b4#ftOfiRSrB!llSfU4v\ 1" 40 k = 0 fcfcttS ->-^*©IM¥©:ft*©fi 

H 2 ©0Sm x/tMLt loo b ( • ) i4i+»fi£«1-. 

£fft£» U fc&lfsfi/ y/CMLTl otf»£2t [0102] 

1". [«2] 
[0 0 9 7] m±OHM^{C*5^Tii, SS*S©it* 



P (n | o) =nb (on) /n b (o) =0. 0 8 
p (n_e | o) = n b (one) / n b (o) = 0 . 0 6 



P (n_e_s_i_x | o) =n b (onesix) /nb (o) = 0. 005 



#ffF 3 0 0 4 2 5 4 



p (e | o_n) = n b (one) /nb (on) = 0 . 9 

P (e_s | o_n) =nb (ones) /nb (on) =0. 00 5 



P (e_s_i_x_o | o_n) = n b (onesixo) / n b (on) = 0 . 0 0 1 
P (s_i_x | o_n_e) = n b (onesix) /nb (one) = 0 . 0 5 



[0 10 3] Xj-yfS 3 O^JSMkarctt, A^x-* 

(a) R«'<7*-*k = 10it©*?*£|| 

[f 40] c 1 a s s 1= {e_s_i_x_o;e;e_t_w_o;n_e_ 

s_i_x ; ; f_o_u_r ; f _o_u_r_f ; . . . ; g_h_t_s ; g_h_t_o 

_n_e!e_i_g_h_t} 

[ft4 1] c 1 a s s 2= {o_n_e;e_s_i_x_o;x;f_i_v; 

f _i_v_e ; t_s_e_v ; s_e_v_e_n ; ; x_n_i ; x_n_i_n_e ; n 

_i_n_e;. . . } 

c 1 a s s 3 = 20 

(b) m;<yt-?k=i<Dkti<D?7xmtt%M 

1*4 2] 

P (e_s_i_x_o | class l) , p (e | class 1) , . . . 
P (°_n_e I class 2) , p (e_s_i_x_o | class 
2) , . . . 

(c) S^7^-^k = 10it^7^V^7A 

[ft 4 3] p (class 1 | class 2) = 0 . 3 
p (class 2 | class 1) = 0 . 1 30 
p (class 3 | class l) = 0. 4 

[0104] ^yys4<Dwmm^mx^ m.^y 

[ft4 4] p (n|o) =0. 9 
p (n_e | o) = 0 . 8 
p (n_e_s | o) = 0 . 0 5 

... 40 
P (n_e_s_i_x | o) = 0 
life 4 5] p (e | o_n) =0.02 
p (e_s | o_n) = 0 . 0 0 1 

P (e_s_i_x_o | o_n) =0 

P (s_i_x | o_n_e) = 0 . 5 

[0105] ujmmimmmn^h. mommm 



(a) tJf/yntZhtzAtiX^m (MLt/^F 
it) 

o_n_e s_i_x o_n_e e_i_g_h_t f_i_v_e z_e_r_o 

(b) ?y*m 

It4 6] classl = (o_n_e;t_h_r_e_e;f_i_v_e; 
s_e_v_e_n ; n_i_n_e } 

c 1 a s s 2= (z_e_r_o;t_w_o;f_o_u_r;s_i_xle_i_g_ 
h_t} 

( C ) tyxmmmmmtDftti 

[ft 4 7] p (o_n_e I class 1) =0. 2 
P (t_h_r_e_e | class l) = 0 . 2 
P (f_i_v_e | class 1) =0. 2 

P (z_e_r_o | class 2) = 0 . 2 
p (t_w_o I class 2) = 0 . 2 

[ft 4 8] p (class 1 | class 2) = 1 
p (class 2 | class l) = 1 

[0106] <mmnm^ : f^mm<Dm2(Dmm 

**-Ma*^*> 5 , </ s >f3*7£*1WT-fc3o 

T<s> good afternoon new Washington hotel may i he 
lp you . . . </s>J 

(a) ^-^y^wft7c*=ftfi©^is mm, m 
msmo&m, skTo^mmttt. 4) , (b) ^7* 

|=1 0 0 0,W(c) W^SWL#VMi=3 

[0107] WRWm. (k = o) m fif-^i; 

fcV^t, 3 0Ie]^Sx-ttliILfc^f§<Z)-r^-C©|l^* 
©ffi^Jtfffttt^MttttSo tot, E«'<7* 
k = 0 \ctotfZi/~sr>x<DM%mm<Dftft<DnM 

[0 10 8] 
[S3] 



(16) 



#ffF 3 0 0 4 2 5 4 



31 32 

p (afternoon I good) 
= nb (good afternoon) /nb (good) =0. 0 8 

p (aftemoon new I good) 
= nb (good afternoon new) /nb (good) =0. 0 6 

p (good afternoon I (s)) 
= nb «s>good afternoon) /nb «s» =0. 0 6 

p ((/s> I may_i_help_you) 
= nb (may i help you </s» /nb day 1 help yon) 
= 0. 005 



[oio9] ^lt, %2<DnMM^mz>&mm 

(a) -fc^yMtSftfcXfrfc^J (MLt^yh 
ft) 

TgoocLafternoon new_washington_hotel may_i_help_y 
ouj 

(b) tyxfeM 

[lfc4 9] c 1 a s s 1= {good_afternoon ; good_mo 
rninglhello ; may_i_help_you. . . } 

c 1 a s s 2 = {new_washington_hotel ; sheraton_ho 
tel ; plaza;. . . } 

c 1 a s s 1 00 0= {give_me_some ; tell_me} 

(c) ?7x&wttmmm<D&fi 
imo] 

p (good_afternoon | class 1) =0. 00 3 
p (goodjnorning | class 1) = 0 . 0 0 2 
p (hello | class 1) =0. 0 0 2 

(d) ^7^/^^7A»MW©M 
[<8fc5 1 ] p (class 2 | class l) =0. 0 4 
p (class 3 | class 1) =0. 0 0 5 

[0 110] <HIS&tfHHig&>#3&ffl#ti, US® 

-tzmwix zo^mfoft. '<7*-*&m%.u ft 

*ffl^^7A, h7^7^^T>©^ftbiJtiSrt 



[0 111] 
[*5 2] 

PP=exp {— (l/T) log (L (W) ) } 

[0112] Tixwiasn^m<D%cX'h 

3. ^-ZfV^ST-J PP#ffiVMJif % *7VKZ>^W 

20 i 19 r t sr^t. Slt^^T^-eit 

fctt 2o»/N°-7°^dr->r fiP PXt/P P* 

U t52©f©L (W) Sr^m^StL-Cf+^$ 

[0 113] 
[S5 3] 

L (W) = 2 L (W, S) 
S 

30 [f54] L (W) =L (W, S*) 

[0 114] 2o<ZV*-7V^>''7VPP*-PPC9M 

[0 115] ^TTii, 5fcf\ fcSit^dUcfcNtsa 
* (PP'-PP) SrfHlU r©«^JI§ft:(Df^ 

1 5) XttfcJ&fftfafrjfe (ftl 6) SrfflV^#fg't5. 
40 fftt, :ilbS5M»On-gram^7/HIV^ 

-^7> ( (Clarkson) (3^1997^) ICiS&fclOCM 

[0 116] 
[*4] 

ej 



(17) 

33 

^1 7-* V 



X<DW. 1 3 6 5 0 2 4 3 0 

Y-tXDWi 1 6 7 0 0 0 2 9 0 0 0 (1%00V) 

mOm. 3 5 2 5 + 2 8 0OOV 



(ft) OOVii, Out Of VocabularyORfjbtl^Stl;^ 

[0 117] *r;vo^7^i:I *^tOn-g r amSU ! 7V-XO-' i !'f^7A|$lt 

*©IWT?S*Wfcfft>nfclWT/1&*ltRf|!f*KoV^T 10 ^yT> (Witten) fcfr (19 9 1^) K£ Z>&%a<D 

(DnmX'h^o n^lEWWm, Msliofcl^ Witten-BellrV^^TMy^feSrFfl^T, Ayy 

tt, "*uh*" fc-eybTy^SnS. * (Katz) (1 9 8 7f) fci54Mn©^y^*7 • XA 

H*fc*3^"C, 7V-X©***ttn=lRi»fe4l54 -3?y ^fe Wt{b^tl5 0 Witten-BellrV 

/M^yAi^ffiS-rS) „ t^TW/^-^f^^A »^«On-g r a m«rfflVVfc#e\ *&<0/<*-7' 

fflftt*5V^T2 0|Hl^T. #gffit*5V^-C 1 0@WT<7> [0 119] 7£^X\ ? 7** J> y^-HTfrftV^fU- 

1 0-3 0O^Hi-fe5fc#> *T-^{il*3V^T, Mft 20 tS^-^i^l-^T^bT-, 7*!7- K ■ /^P- 

lifcv\ SttoS^OLtvHitt^Wift^-efcS. ^4ftPP*XtfPPfc&®*K:*1-. ^-7V3->t- 

[0 1 18] .LfrLfttffe, t'<t©l|^7l'-X -r*©S (PP'-PP) ttaft, ^-TV^t^ 

W-Xsi&U ? s J ^l^M7^-Xffe9, U~Xfc##LTi, ^SiOjEfllS^^SlCliftbtlS 

c ( Sl , Sl ) (Dwrnfemmx-hzt, c ^tm^xit^b^^ztm^Lx^^. 

(s,, Si ) ill K])±y hZtlio ) > t^X<D7~h' [0 12 0] 





1 2 


3 4 


pp 


5 6.0 4 3.9 


4 4.2 4 5.0 


pp* 


5 6.0 4 5.1 


4 5.4 4 6.3 



[0 12 1] &lv?, SS^I©lf^t'S, 7*7 * ^tVMK X£jfc<D££*1- 0 

— k • Ay try — V7A=t y x^xti tr^ t«7/w^ [0122] 

yXA(7>V^^SrffiV^-7°^^7 1 ^ffiPP*& * [j?6] 
«Ut*SO*»:r^b^-7-u*^-fft PP* 



n 


1 2 


3 4 


FBft 


5 6.0 4 5. 


1 4 5.4 4 6.3 


tr* if 


5 6.0 4 5. 


7 4 5.9 4 6.2 




★ 


★ [*7] 




: ^TVVCOIMX 






1 2 


3 4 



#ff 3004254 

34 



#fF 3004254 



FBft 32 505 

M9 tTSSfe 3 2 5 0 5 



4 4 3 8 2 
6 5 14 1 



4 3 6 7 2 
6 7 2 5 8 



4 3 18 6 
6 7 2 9 5 



[0 12 4] *6XU«7!6»bWb*»4J:5fc» '<-7* 

/<^^!7-KTA'='9XA|Cj;5¥Sli:*SV^-Ci|ISl3 0% 10 
{C^fLT, 33*5^^4 0, 00 0M6 0, 0 0 0©lV^ 
[0 12 5] /W-^/Uf^^A^li, MLT, 7V 

n-g r am©JtiR 



* <(i6^f 3 8!5tS7i^5ft#tt?rS*t5) n = 3, 

4©^-yi/^->x^tt(i, m&mum\mfe£fo 

5) n = 2©i#©^tU!9&S<&5„ ffi©*^ 
* < f4Mi > © J; 0 t>fiv^7 is-Xttfflfc-tZ 4 5 

[0 12 6] n-g r a m i ©JfctfcfcfcV^T 

Ji, 7 * !7 - K • /< y 9 7 - Y7;v =f ]} XA \c ± 

a»&#&ftfc/<-7V*i/7Vf[ (PP) , n-gra 

[0 12 7] 
[*8] 



[0 12 8] 



^7 r-^-TV^r^Mit 


PP 






1 


2 3 


4 


n — g r a m 


3 14.2 
5 6.0 


5 6.0 4 0.4 
4 3.9 4 4.2 


3 9. 8 

4 5. 0 


n-gra m©itg 




* * [*9] 






n« 


1 


2 3 


4 


n — g r am 


3 5 2 6 
3 2 5 0 5 


32505 75511 
44382 43672 


112 14 8 
4 3 18 6 



[0 12 9] *8Xtf*9i»bWbi»4J:5^ ^"bffi 

W<xf— ?/l'f^7^-7'^->T>f^='7 (4 3. 
9) (4, h7^7A©«4^ftf^LTifSV^\ /< 
•Y^-MS (5 6. 0) int>7^^7A{| (4 0. 
4) {CiOSV^t*o-CV^5 0 £f>K % h7^f^7A 40 

7-Y7~7A©/n-71/^^t-i'(^ 4 8. ltfcofc, 
[0 13 0] (JJE* 
icl*£T) 144 0. 4-gram^37J;!) 

/q-v/Uf^yAtfyWiy r- !J$tJ4 h7-f 7*7-^ 
^&7 f /l'©xyHJjBcJ:9t^ft< (4 5 0 0 0 I^LT 50 



7 5 0 0 0) , v^^^^A^^-fS^X/^WiElttt 
t^T^t4 Xm<D h V- K^-7^$tlTV"5. 
[0 13 1] Sfelt, 7 7 7.^y y^fcJBVVfcllRXtf 
HRfe^lcoV^Tifi^S. *H»T?f4, 7W-X©^7 

(l*VymT) ©(4, 7U-X©HA/©-» (10 
-20%) ©*flS*7**i:45l$-C*>!K rftSr®*. 

?7*$£;3Wlt£i^3£ft&l^ n-g r am 

7i^-x©7 77.^yy^(c < to-t, m%mz¥r 

5feT n = 4MS-t?©7i/-X^ft5 j e7>©^ 



(19) #lf3 0 0 4 2 5 4 

37 38 

X\ iVi£f^£*cf "*uh*" Sr-atf7U-Xi±ro [0 13 2] 

a©±^t*-r 0 mc^ m<Dm^£¥wc£%7u-* [tio] 



{y es_that_wi 1 1 ; * uh* _that_would} 

{yes_that_will_be; uh _yes_that' s} 

{ uh _by_the ; and_by_the} 

{yes_ uh _i;i_see_i} 

{okay_i_understand ; uh _yes_please} 

{could_you_recommend; uh _is_there} 

{ uh _could_you_tell;and_could_you_tell} 

{so_that_wi 11 ; yes_that_wi 1 1 ; yes_that_would;uh* _that_would} 

{if_possible_i' d_like;we_would_like;* uh*_i_want} 

{that_sounds_good; uh _i_understand} 

{ uh _i_really; uh*_i_don't} 

{ uh _i'm_staying;and_i'm_staying} 

{all_right_we; uh _yes_i} 



{good_morning_this;good_afternoon_this} 

{yes_i_do ; yes_thank_you} 

{we' 1 l_be_looking_f orward ; we_look_f orward} 

{ do 1 1 ar s_a_n ight ; and_f or t y_y en} 

{f or_your_help ; for_your_information} 

{hold_the_l ine ; want_for_a_moment} 

{yes_that_will_be;and_could_you_tell} 

{please_go_ahead ; you_l ike_to_know} 

{want_t i me_wou 1 d_y ou ; and_y ou_wou 1 d} 

{yes_there_is;but_there_is} 

{ join _phi 1 1 ips_in_room;ms. _suzuki_in} 

{narae_is_suzuki ;name_is_ms. _suzuki} 

{i'm_calling_from;a;also_i' d_like} 

{much_does_it_cost ; can_reach_you} 

{thousand_yen_room ; dol lars_per_person} 

{yes_i_do ; yes_thank_you ; i_see_sir} 

{you_tel l_me_where ; you_tell_me_what} 

{a_reservation_for_the;the_reservation_for} 

{your_name_and_the ; you _gi ve_me_the) 

{amy_harris_in ; is_amy_harris_in} 

{name_is_mary_phillips;name_is_kazuo_suzuki} 

{hold_on_a_moment ; wai t_a_inoment} 

{give_me_some ; also_tel l_me} 



[0 13 3] %7^y (Kawahara) h (l 99 7f) \Z 

itui, ±.B(nm-&£bK, ^m^mtitm^ 7u- 



mmzmxzztoici-ztciibim, m 

^iXt'-J-T? (speech act tags) (D £5 ft 

lKo^<Z>i9S^l^/Wtt«£^T7 WX77 

[0134] U±.mm Ltd 0 7 U-X'mcn - g 



(20) 

39 

^ttfc, #^^^©ffi^-^li ££7W- 

ft i u mwrnw d i o r $ b Kiefe 
*st5ri:^tii45. sbm, mmmtmm^ io 

ft $ £ 5 7 X #a © 7 ^Srftl 9 S T 5 £ t 

x\ y y^wfg3«©#»i':fc^-c 

v\ftti, 7i/-x^7^^#5fefe©^a^sijps^^(t 

[0 13 5] <«J^>#±©|QBB»C*i^-CHU * 
ftS&Stt, :miJ£*f!c©$I&©?JK#gU ±B« 20 

iswirfticpib-r, mm, B*R44r©ft©i«w 
[oi36] <mmmn<D%!%>sxmwitci. 5 

m&*Tf-5. 30 
(A) EM7/V3U XASrftlL-C*ISO'>-^y^O 

(b) 5/-*y*$HS©ilW*S*fc:t5rfc#-ct 

^y xAirjiv^aao^^i^o^ $m 
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